Quantum Simpson's Paradox and High Order Bell-Tsirelson Inequalities 
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The well-known Simpson's Paradox, or Yule-Simpson Effect, in statistics is often illustrated by 
the following thought experiment: A drug may be found in a trial to increase the survival rate 
for both men and women, but decrease the rate for all the subjects as a whole. This paradoxical 
reversal effect has been found in numerous datasets across many disciplines, and is now included in 
most introductory statistics textbooks. In the language of the drug trial, the effect is impossible, 
however, if both treatment groups' survival rates are higher than both control groups'. Here we show 
that for quantum probabilities, such a reversal remains possible. In particular, a "quantum drug", 
so to speak, could be life-saving for both men and women yet deadly for the whole population. We 
further identify a simple inequality on conditional probabilities that must hold classically but is 
violated by our quantum scenarios, and completely characterize the maximum quantum violation. 
As polynomial inequalities on entries of the density operator, our inequalities are of degree 6. 

PACS numbers: 03.65.Ud, 03.65.Ta, 03.67.-a, 02.50.-r 
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Simpson [T] used a thought clinical trial of a drug to 
illustrate the possibility that an association found in sub- 
groups of a population may disappear, or even reversed, 
on the population as a whole. Denote by R{ , i?J", Rt, 
RI, i?™, and Re the recovery rates of the female, the 
male, and the combined treatment groups, respectively. 
As depicted in Box CI of Fig. [l] r{ > i?/, i?™ > i?™, 
indicating a beneficial effect on both the females and the 
males. However, for the combined control and treatment 
groups, Rt — Re, erasing the beneficial effect. With small 
modifications as shown in C2, Rt < Re, reversing the 
beneficial effect. Numerous real-life datasets from many 
fields such as epidemiology, social sciences, psychology, 
and sports, have been found to exhibit this reversal. The 
result, called Simpson's Paradox or the Yule-Simpson Ef- 
fect, among several other names, is included in most in- 
troductory statistics textbooks. 

To allow a generalization to quantum probabilities, 
we discuss Simpson's Paradox in the following model. 
Define a (measurement) scenario M = {\(j)),G,E,R), 
where \(j)) is a quantum state, and G, E, R are two- 
outcome measurements on the state space of |(/)). For 
convenience of exposition, we refer to G, E, and R as the 
Gender, the Treatment, and the Result measurements, 
respectively, and name the outcomes as Female/Male 
(F/M), Untreated/Treated (U/T), and Alive/Dead 
(A/D), correspondingly. 

Given A4, consider two experiments. The first is to 
measure Gender, followed by Treatment, and finally Re- 
sult. The second is the same, except not measuring Gen- 
der. The two experiments define the conditional prob- 
abilities Rt, Rt, etc. discussed above. For example, 

Rt =^Pr(A|r), R{ =Vy{A\FT), etc. 

A classical scenario is one where the measurements 
commute, i.e., changing the order of applying the mea- 
surements does not alter the outcome statistics. Conse- 



quently, Rt can lie anywhere between Ri and i?™ (and 
likewise for Re). More precisely. 



Rt = afR{ + UmRln^ 



(1) 



where a/ {am) is the fraction of female (male, respec- 
tively) subjects in the combined treatment group, i.e., 
Pr(F|r) (or Pr(M|T), respectively). We refer to this re- 
lation as the convexity property. When the "treatment 
interval" delimited by R{ and R^ intersects with the 
"control interval" delimited by R{ and i?™, a reversal 
becomes possible (and requires that the gender distribu- 
tions are different). Conversely, when the two intervals 
are disjoint, i.e., R{,R^ > R(,R'^, then no reversal is 
possible. Such is the case depicted in CI, as well as in C3 
when r{ = RT = 99%, and Rl = R"^ = 33%. 

In sharp contrast, we show that for non-classical sce- 
narios, a reversal under disjoint rate intervals remains 
possible. Ql in Fig.[l]shows that, with r{ = R^ ^ 99% 
and R[ — R^ = 33%, Rt can be reduced to and Re 
increased to 50%, as opposed to in the classical case re- 
maining at 99% and 33%, respectively. In the more ex- 
treme quantum scenario Q2, "taking the drug", so to 
speak, increases the survival rate of both gender groups 
from almost to almost 1, yet reduces the rate for the 
combined groups to 0. 

Such a reversal is inherently quantum as the convexity 
property must fail. Denote by dt = Rl -\- R^ — Rt, de = 
Rl + Re^ — Re and S = dt — de. For classical scenarios, the 
convexity property implies that \S\ < 1. Therefore, the 
value of jS"! exceeding 1 in quantum scenarios quantifies 
intuitively the extent of an inherently quantum reversal. 
Ql has S ~ 7/6 while Q2 has S arbitrarily close to 2. 
We shall prove that 2 is precisely the quantum limit, 
i.e., jS"! < 2 for all quantum scenarios. In particular, 
a maximum violation of the convexity property cannot 
occur simultaneously for Rt and Re. 





CI 


: Simpson's 


0.62 - 


t, R,'".8/13 


i 0.57 - 


R|^=4/7 o 




S 0.50 - 


Rc.6/12,, ,,R,.20/40 


8 

a 0.44 - 

0.40 - 


i r|.12/27 
R|,=2/5 i 

Untreated Treated 



C2: Modified Simpson's 



Ci: Ciassicaiiy no reversai 



0.62 ■ 
0.59 ■ 
0.56 ■ 



0.44 ■ 
0.40 ■ 



R^=16/27(: 
Rc=18/32( 




- 


R[^=8/13 






( 


Rt=20/40 






( 


r|=12/27 


Rc=2/5 J 






Untreated 


Treated 





a Rf 




{) Rt 




Ir; 


R% 




Re I 




Re I 




Untreated 


Treated 



C3 


Ciassicaiiy 


no reversai 






G Ri=Rt =Rt 


r|.=R"=Rc o 






Untreated 


Treated 



0.50 
0.33 



Q1 : Quantum reversal 




°Ri=Rr 


R=o 




Rc-R" o 






oRi 


Untreated 


Treated 



Q2: Quantum reversai 



'"o 





°r!.r,- 


R=„ 
Rc=R" o 


o Rt 


Untreated 


Treated 



FIG. 1: The survival rates in scenarios for the classical and quantum Simpson's Paradox. Simpson's original 
example CI shows that the positive treatment effect among the males and the females disappears when the two groups are 
combined. Each fraction is the number of surviving subjects divided by the total number of subjects in the corresponding 
group. Changing the subject numbers in the male treatment group leads to a reversal C2. Ql and Q2 demonstrate classically 
impossible quantum reversals, as in both scenarios, the treatment interval is far higher the control interval, yet the combined 
treatment group's rate falls below that for the combined control group. The line segments depict rate intervals. The convexity 
property fails simultaneously for the treatment and the control groups. The classical scenario C3 is to contrast with Ql as 
they behave the same on all subgroups but C3's combined rates do not change due to the convexity property. Q2 holds for all 
sufficiently small e > with 0{e^) precision. It represents a family of maximum quantum reversal, as S ~ 2 — 2e — >■ 2. 



Before we present the details for the construction and 
the proof, we sketch below the underlying intuitions. A 
fundamental feature of quantum mechanics is that mea- 
suring a quantum system may in general change the 
state of the system. Furthermore, two different quantum 
measurements may be non- commuting, a consequence of 
which is that the state change incurred by one measure- 
ment would alter the outcome statistics of subsequently 
applying the other. This is the critical property that 
underlies our constructions, as well as the Heisenberg 
Uncertainty Principle, and other well-known quantum 
paradoxes such as the EPR Paradox [2, and the GHZ 
Paradox [5]. 

In our construction, the Gender and the Treatment 
measurements are non-commuting (though both com- 
mute with the Result measurement). Thus adding the 
Gender measurement may change dramatically the out- 
come statistics of the subsequent measurements. More 
specifically, the extremal violation of the convexity prop- 
erty dt — >■ 2 is a consequence of the following features 
(illustrated in Fig. [2]): (1) The Treatment portion of the 
quantum state has a small amplitude in the Dead sub- 
space, but a vanishing amplitude in the Alive subspace. 
This implies Rt = 0. (2) After measuring Gender, both 
eigenstates retain a tiny amplitude in the Dead subspace, 
but a much larger, even though still small, amplitude in 
the Alive subspace. This gives Rf = i?™ — >■ 1, and with 
(!) dt —>■ 2. Ql and Q2 are constructed so that dt —>■ 2 



and at the same time dc is made small. We note that 
unlike in the violation of spatial Bell inequalities, entan- 
glement is perhaps not relevant in our setting. 

That jS"! < 2 follows from the necessary tradeoff be- 
tween dt and d^. The tradeoff is most intuitive when con- 
sidering why extremal violation of the convexity property 
cannot take place simultaneously on dt and dc (in oppo- 
site directions). An extremal violation on dt require the 
above two features (though "vanishing" can be replaced 
by "very smaU"). Consequently, Pt{AT) and Pr(Z)r) 
are small. Similarly, that dc — >■ —2 implies Pr{AU) and 
Pi{DU) are also small, contradicting that the sum of 
those four probabilities is 1. 

We now discuss the implications of our results and 
compare them with related works. Simpson's Paradox is 
important for revealing the pitfalls of drawing causal con- 
clusions from partitioned data, and for guiding statistics- 
based decision making [1]. Our quantum reversal effect 
can play a similar role when examining quantum mea- 
surement data. With the rapid advances in experimental 
quantum science and engineering, it is anticipated that 
quantum technologies will be widely used for research 
and applications in the future. Thus there will be more 
contexts of scientific and practical importance to which 
our result is directly relevant. 

Our inequalities share the same features of the cel- 
ebrated Bell Inequalities [B] and Tsirelson Inequali- 
ties |7i for differentiating classical and quantum proba- 



bilities, and for bounding the latter, respectively. How- 
ever, a quantum system is measured only once in Bell- 
Tsirelson inequalities, while ours involve repeated mea- 
surements. Bell-Tsirelson type inequalities on outcomes 
of repeated measurements have been discussed by many 
authors in the framework introduced by Leggett and 
Garg , and the related framework of "quantum entan- 
glement in time" introduced by Brukner et al. [9] . Those 
inequalities are referred to as temporal, in contrast to the 
traditional, or spatial, inequalities. They bound quan- 
tities that are linear in the outcome correlations of re- 
peated measurements. Consequently, they are on linear 
functions of entries of the density operator, just as the 
spatial Bell-Tsirelson inequalities. In contrast, our in- 
equalities, in an equivalent form, bound polynomials of 
higher order (degree 6). 

Thus, if one interprets broadly the terms Bell and 
Tsirelson Inequalities as inequalities bounding functions 
of the measurement outcome probabilities for classical, 
and quantum, respectively, models, our inequalities may 
be appropriately called high order Bell-Tsirelson inequal- 
ities. We note that quadratic Bell-Tsirelson inequalities 
were proved by Uffink [10] in a different context. We 
emphasize that the value of such high order inequalities 
does not lie in the degree per se, but in that they may, as 
in our case, provide a different, informative, and intuitive 
understanding of quantum effect. 

We speculate that a quantum reversal may also occur 
in some classical settings such as human decision making. 
For example, in the well-known "Disjunction Effect" [TT] 
experiment, the human subjects overall preferred Deci- 
sion A than B on learning either value of a two-outcome 
random variable W . Paradoxically, B was preferred in- 
stead statistically when VF's value was not revealed even 
though the subject knew it was already determined. The 
effect can be interpreted as a consequence of a violation 
of the convexity property, similar to our quantum rever- 
sal. Note that a "quantum" reversal in such a setting 
does not contradict our earlier conclusion of classical im- 
possibility as the subject's preference does not have a 
definite value. This indefinite nature resembles that of 
the outcome of quantum measurements, or in the lan- 
guage used by EPR [5], the non-existence of "elements 
of reality" . Indeed, the nascent area of quantum cogni- 
tion [12| was partly motivated by the Disjunction Effect 
to use quantum probabilities for modeling human cogni- 
tive processes. 

Construction. For two quantum states \a) and |/3), 
denote by \{a±(3)) the state -^(|a) ± |/3)). We will use 
nested parentheses but may omit the outer-most pair. 
For example |a + (/3 - 7)) ^ ^(|a) + ^(|/3) - h)))- 

Set H — V ® W, where V has dimension 4 with an or- 
thonormal basis {\t), \uq), |ui), \u2)}, and W has dimen- 
sion 2 with an orthonormal basis {\a), \d)}. The measure- 
ment R acts only on W, while G and E act on V only. 



Denote by i?"* the Alive eigenspace, or the projection to 
this eigenspace, of R, and similarly define R^ , E'^ , etc. 
The measurements are defined through their eigenspaces 

i?^ =^ span{|a)}, i?^ =^ span{|d)}, 

E^ = span{|i)}, E" =''span{|u,) : < i < 2}. 

To define G, we first define the following states: 



\h)^^'\{uo + u,)+t), |/i>'=^'M, 



(2) 



|"io) = \{un + ui)-t), |toi) = |uo-ui). (3) 
Now define 

G^ = span{|/o), |/i)} and G^^ = span{|mo), |toi)}. 
For p,q>Q, define 

I0q) = ^/p\uo + Ul),m\d (4) 

\<j^d) = \{uo-u^)+U2)+^\t). (5) 

Finally, define (the unnormalized) 

I ,, dcf 



\(t>a)®\a) + \(t)d)®\d). 
By direct computation. 



(6) 



P{D\T) = 1, (7) 

P{A\U) = pI{1+p), (8) 

P{A\TF) = P{A\TM) = p/{p + q), (9) 

P{D\UF)^PiD\UM) = {2 + q)/{2+p + q).{10) 

When p = 1, q = e — 7> 0, we have Ql. When q = p^ 
and p = e — >■ 0, we have Q2. Those two examples are 
illustrated in Fig. [2] 

Bounding the quantum violation. We prove here 
|5'(7\/f)| < 2 for all measurement scenario Ai. It suf- 
fices to prove that S" = S* -I- 3 < 5. Without loss of 
generality we assume that the measurements are all pro- 
jective (as otherwise we can replace each POVM by a 
projective measurement on the extended Hilbert space). 

To simplify notation, we define £j:it = \\R^E'^\'I')\\^ 



Iatf " WR^E^G' 



etc. and. 



del i AT dci H-DTF dci (^DTM /, -, x 

t-DT I^ATF I^ATM 

„ dcf i-DU a dci (.AUF r, dciiAUM .,„\ 

P = 7 ; PF = -„ , PM = -. ■ (12) 

t-AC/ (-DUF (-DUM 

Then 

S' = {1 + a^^ + {1 + al)-^ + {1 + alj)-^ + 

(1 + /32)-i + (1 + /3|,)-i + (1 + /3l)-\{l3) 

By the triangle inequality, 

£dt < f-DTF + iuTM = ap^'ATF + OLm^-ATM (14) 
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FIG. 2: Each of the three axes corresponds to one of the three measurements and each face is annotated with a measurement 
outcome. Each face, edge, and vertex represent the resulting state after one, two, or three, respectively, measurements, for the 
measurement outcomes determined by the faces incident to it, and annotated with the squared lengths (for those projections 
in S). For example, Ql's lower-left-closer vertex represents R' E^ G^\(^ and has a squared length 1/4. 



and, 



Thus 



'^AU 



< 



•AUF 



Decomposing 1 



+ ^AUM — Pf^DUF + Pm^DUM- 

= \\\<t>)\\'^ in two ways, we have 






(15) 



(16) 



If Idt = or Iau = 0, S" < 5. It is straightforward to 
verify that 5" ^ 5 in either case. Thus S' < 5. Consider 
now that IdTj^au 7^ 0. Suppose that 



l + a^ > il + a%,-^ 



2 
ATF 



(1 



DT 



^2 



(18) 



1 + I3^>{1 + Pi) 



'■-DVF 
^AU 



(1 



/3m 



'"DUM 
'^AU 



(22) 



The proof that S" < 5 is similar as for the case when 
( 18 1 holds. This completes the proof that 5" < 5 , thus 



[^(A^)! < 2, for all measurement scenario M. 
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{\ + a")-^ + [l + a'p)-^ + {1 + alj)- 
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(1 



/2 p2 

^2 \'^ATF I /I I ^2 \'^ATM 
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P 



(1 
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*MJ 



< 2. 



(19) 
(20) 



The second inequality follows by optimizing over all 
and ^#21^ 



that satisfy (14). Thus S" < 5. A direct com- 



putation shows that equality cannot hold. Thus S" < 5. 



We need only consider the case when ( 18 1 fails. Rear- 



ranging Eqn. ( 16 ) 



£1,^ (l-Ha^)-(l + a^) 



'-ATF 



(1 
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2 \''ATM 
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^nu -i^ + n + a + pF) 



'DUF 
P 



'^AU 



(21) 



* Electronic address: shiyy@eecs.umich.edu 

[1] E. Simpson, Journal of the Royal Statistical Society, Se- 
ries B 49, 238 (1951). 

[2] A. Einstein, B. Podolsky, and N. Rosen, Phys. Rev. 47, 
777 (1935). 

[3] D. Greenberger, M. Home, and A. Zeilinger, in Bell's 
Theorem, Quantum Theory, and Conceptions of the Uni- 
verse, edited by M. Kafatos (Kluwer, Dordrecht, 1989), 
pp. 69 - 72. 

[4] J. Pearl, Causality: Models Reasoning and Inference 
(Gambridge Univ. Press, 2000). 

[5] J. S. Bell, Physics 1, 195 (1964). 

[6] J. F. Clauser, M. A. Home, A. Shimony, and R. A. Holt, 
Phys. Rev. Lett. 23, 880 (1969). 

[7] B. Girel'son, Letters in Mathematical Physics 4, 93 
(1980). 

[8] A. J. Leggett and A. Garg, Phys. Rev. Lett. 54, 857 
(1985). 

[9] C. Brukner, S. Taylor, S. Gheung, and V. Vedral (2004), 
arXiv:quant-ph/0402127. 
[10] J. UfHnk, Phys. Rev. Lett. 88, 230406 (2002). 
[11] A. Tversky and E. Shafir, Psychological Science 3, pp. 
305 (1992). 



[12] P. Bruza, J. R. Busemcyer, and L. Gabora, Journal of Quantum Cognition. 

Mathematical Psychology 53, 303 (2009), special Issue: 



